Devin's use in improving Team Mirai policy

2025-05-22

I'll summarize it in bullet points as it might make an interesting case study for a Note article later.

There are 1400+ PRs for the policy

If we try to analyze all of these cases, we will hit the Rate Limit (5000 cases / hour) of the Github API.

Wrote code to get hourly up-to-date data and convert to JSON using Github Actions.

Now you can get 1,000 PRs per hour.

Data is placed here.

By instructing Devin in Japanese, I was able to use this data to extract specific conditions from all PRs and create a CSV

Instruct from Slack and have the resulting CSV attached to Slack.

Results were obtained in two minutes.

This has created a system where non-engineers can direct "the type of analysis that requires some implementation" 24 hours a day and get results in a matter of minutes.

---